Correlation effects in a discrete quantum random walk 
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We introduce history-dependent discrete-time quantum random walk models by adding unconelated memory 
terms and also by modifying Hamiltonian of the walker to include couplings with memory-keeping agents. 
We next numerically study the correlation effects in these models. We also propose a correlation exponent 
as a relevant and promising tool for investigation of correlation or memory (hence non-Markovian) effects. 
Our analysis can easily be applied to more realistic models in which different regimes may emerge because of 
competition between different underlying physical mechanisms. 
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Introduction. — "Random walks" (RWs) is an important 
and prevalent concept in various branches of science in 
that many phenomena can be modeled by using the associated 
notions or tools. A classical random walk (CRW) is the dy- 
namics of a classical (i.e., non-quantum) object — which will 
be called "particle" or "walker" hereon — within a fully or 
partially stochastic environment and/or under some stochastic 
forces. A famous example of such an evolution is encoun- 
tered in non-equilibrium statistical mechanics of gas particles 
inside a cylinder Configuration or state of the walker in a 
CRW can be described by a local (classically measurable) 
quantity, such as its "position" (not necessarily real-space po- 
sition) at each step (or "time"), x{t). A general, and therefore, 
context-free modeling of a CRW is provided when one can 
introduce stochasticity/randomness via inclusion of a random 
object such as a "coin". A characteristic of a RW is its vari- 
ance or dispersion, cr^ = (a;(i)^) — (a;(f;))^, where (.) indicates 
an ensemble average. For a CRW, this quantity for long times 
shows a linear behavior with the total walk time: ~ T, 
which is a characteristic of a diffusive motion. More general- 
izations of CRW can be found in literature, for example see 
Refs. iSlllllllllTt] and the references therein. 

Recently, there has been a great interest in the dynamics 
of a quantum random walk (QRW), a quantum object hop- 
ping (discretely or continuously) on a graph — e.g., a line 
— based on an intrinsically quantum mechanical decision- 
makingjn each step, e.g., b y a quantum coin in a discrete 



makingin each step . 
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has been shown that the language of a (continuous) QRW, as- 
sisted with suitable Hamiltonian maps, can provide a universal 
framework for the studies on general qubit systems llSll . One 
should note that in this type of RWs an external object like a 
quantum coin is not necessary. In a QRW, the combined dy- 
namics of the coin and the walker is governed by a unitary 
operation Ucw (acting on He ® Tiw), which introduces quan- 
tum effects such as coherence and entanglement and results 
in interference between classical paths. This quantum nature 
is responsible for the features radically different than those of 
a CRW, such as: a different, spread non-Gaussian probability 
distribution P(x . t) | fl2llT6ll . a quadratically faster spreading 
(the ballistic motion), the exponen- 




tially faster propagation between particular nodes of a specific 
graph nil El. 

Of our special interest in this paper is to numerically in- 
vestigate how "memory-effects" or "correlations" show up 
and play a role in the general behavior of a (discrete, coined) 
QRW. In a RW, the dynamics in every time is generally dic- 
tated by the history of the previous step(s) and the coin-flip(s). 
When the dynamics is Markovian, in principle there is no his- 
tory in the system, and, the walker's immediate future is de- 
cided only based on its present and an immediate coin-flip 
llf]. In other words, in a Markovian CRW, by definition, the 
walker does not keep any memory of its state in previous 
times. From a physical point of view, it seems that when 
the walker is interacting with a slowly-responding environ- 
ment — slow relative to the characteristic time of the walk — 
it is unlikely that the environment can feed some of the ac- 
quired (or leaked) information back to the walker, and there- 
fore, affect its future moves. In this case, the leading effect 
would be a loss of memory, and accordingly, emergence of a 
regime in which the Markovian assumption is a valid approx- 
imation. As a result, it is expected that in this regime, there 
would be a negligible correlation between the configurations 
in distant times. In open quantum systems the analysis of non- 
Markovian effects is more involved than in the classical case 
and adding a memory kernel to equations has many complex 
aspects Ipllj]. Besides, unlike the classical case, in open quan- 
tum systems one cannot use the standard approaches like the 
Chapman-Kolmogorov equation to test the Markovian prop- 
erty I22II . because the related joint probabilities might be not 
well-defined from quantum mechanical perspective. Recently, 
however, some preliminary progress was reported regarding 
how to decide whether a quantum channel is Markovian or 
not H . 

In a discrete QRW, the stepwise coin-walker dynamics, 
i.e., \^{t + l))cw = C^cw|*(i))cw for t ^ T, may im- 
ply a Markovian characteristic for the walker's dynamics as 
well. Although for the coin-walker system the dynamics is 
indeed Markovian (or memoryless), this is not generally the 
case for the walker's state alone 12411 . It has been shown that 
due to the quantum entanglement between the coin's and the 
walker's states, there can exist a "pseudo" memory (hence 
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non-Markovian effect) in the RW after tracing out over the 
coin at the last step (or after a few steps). Precisely speaking, 
in the case of a standard discrete-time QRW with a localized 
initial state, the quantum probability distribution Pquant. (-c, t) 
is related to all classical probabilities {Pciass.(a;, t') : t' ^ t} 
(with the same initial conditions). Tracing over the coin im- 
mediately after each step, and averaging over all possible mea- 
surement results, generates a CRW 12511 . This is typical of 
systems under decoherence or interaction with an external en- 
vironment. When the environment observes or measures the 
system, some coherence, hence dynamical information, would 
become inaccessible and the system tends to lose its quan- 
tum correlations. This has been anticipated as a usual route 
to manifest classical-like behavior in quantum systems. In 
the case of a QRW, there are numerous studies specializing 
on how different sources of decoherence can affect a QRW 
and induce a transition to a CRW. E.g., tracing over the coin 
after each step or replacing the used coin with a new one at 
each step (multiple coins) and tracing over all of them after 
a while ||25, 2^ 27], random phase noise on the coin state 
lITs . 281. unitary stochastic noise lEoll . periodic coin and/or 



walker measurements or randomly broken links on the graph 
Isoll — for a general review see Ref. jsill . In these stud- 
ies, the long-time behavior of variance cr^, for its different 
scalings for the standard CRW and QRW (as discussed ear- 
lier), has been adopted as an indicator to distinguish "classi- 
cal" and "quantum" regimes of a RW 12511 . This approach, 
although very fruitful, is not necessarily conclusive in that 
there are quantum diffusion models featuring sub-ballistic, the 
so-called "anomalous" diffusion, or other types of behaviors 
This implies that a deeper characterization of 
different regimes in quantum systems by other stronger tools 
is necessary. Moreover, there is still no clear understanding 
about possible roles memory, correlations, or related environ- 
mental effects might play in appearance of different regimes in 
an open system QRW or transitions between such regimes. A 
study in this line, therefore, might shed some light and bridge 
between seemingly different underlying notions and physical 
behaviors. Here we report a numerical preUminary step that 
may fill some blanks. 

In the following, we introduce a few simple QRW mod- 
els in which a memory/history-keeping feature is included. 
First we add a non-Markovian property to a QRW as an 
uncorrected mixing of the states at different instants. We 
show how variance for these models behave vs time, signal- 
ing the inadequacy of this quantity for distinguishing differ- 
ent regimes. Next, we consider a more physically motivated 
model in which, in addition to the coin and the walker, a sim- 
ple harmonic oscillator has been coupled to play as a history- 
keeping agent. We define the concepts of correlation and cor- 
relation exponent as useful tools for evaluating the effect of 
memory. The correlation exponent for our model is calculated 
numerically and contrasted with the exponents of a memory- 
dependent CRW model This analysis implies that adding 
memory may induce anti-correlation similar to what is seen in 
a self-avoiding CRW. 
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FIG. 1: (color online). Variance vs time for the model in Eq. (T), 
with M = 2, Ti = r, and r2 = 1 - r, T = 100 and p = 1/2. 
The inset shows the values of V and the parameters in the fitting 

~ at^ + fet + c. 



Uncorrelated history-dependence. — We start by a brief 
review of the standard (memoryless, discrete) QRW lfl6ll . 
This model consists of a finite one-dimensional integer lat- 
tice forming the walker's space, Tiw = span{|a-)}^^_^, and 
a chirality (or spin) degree of freedom. Tie = span{|±)}, 
constituting the coin space. The dynamics of |^'(t))cw is in- 
duced by the unitary operator Ucw{p) = {P+ ® + P_ (E) 
S^){uc{p)iS)iw), where P± are projection operators onto Tie, 
S = J2x=-L \^ + l)w(a:^| is the shift operator on the graph, 
and uc{p) = ^-'^) ' *-* ^ P ^ is a unitary quantum 

coin tossing operator. 

Intuitively, one might imagine that a memory-dependent 
model of a QRW can be built by considering that the state 
\^{t + M))cw is obtained from some operation on a lin- 
ear combination of the states in the M previous instants: 
W^(t + m))cw}m=o ■ This simple approach is unfortunately 
doomed to be non-linear hence unphysical, though. There are 
various ways to avoid non-linearity. Here we consider two 
simple (though not necessarily physically motivated) models 
in which the states at different instants are mixed in an un- 
correlated and random manner. A rather similar approach has 
already been used to numerically investigate decoherence ef- 
fects on a QRW 136]. 

The first model is based on the density matrices in the M 
previous steps 



Here, s$ s$ 1 and X^fe Tfc 1 and A^a'^ is the Kraus 

operator given by yl^"' = (cr |C/^w I C)' where |C) = C+|+) + 
C_|— ) is the initial state of the coin. Non-Markovian char- 
acteristic of this model is apparent for the history-dependence 
of the walker's state on its M previous instances. Another 
feature inferred from Eq. ([T]i is that in every step we discard 
the coin, tracing out over it to obtain pw, and use a fresh coin 
prepared as |C) for the next step (multiple coins). Indeed, in- 
cluding multiple coins has already been identified as a way 
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FIG. 2: (color online). Positions of the peaks of the probability distri- 
bution att — 100 for the evolution described in Eq. m. This model 
exhibits bimodal (unimodal) behavior for < T < 0.8 (T > 0.8). 



to include history in a QRW Il27ll . For a balanced initial coin 
(C+ = -iC- = l/\/2) and a balanced coin-flip (p = 1/2), 
if Fi = 1 we obtain a behavior similar to an unbiased mem- 
oryless CRW in the sense of variance (see Fig. [T]i. Degree 
of history-dependence of the model is adjusted by F^s. For 
numerical simulations, in addition to the aforementioned con- 
ditions, we have taken M = 2 and T = 100, with the walker 
initially localized at the origin. Figure |2] depicts the peaks of 
the probability distribution P{x, 100) for varying F. Notice 
that for a range of values of F, the probability distribution ex- 
hibits a bimodal behavior, similar to a memoryless QRW. As 
F increases, the the peaks approach each other and eventu- 
ally merge into one for F w 0.8. As indicated in the inset of 
Fig.[T] for this walk a cr^ ^ a{r)t'^ + b{r)t + c(F) fitting can 
be found for different values of F — with ^ t for F = 1 . 
In this respect this model shows characteristics of both QRW 
and CRW for different ranges of F. 

The second model is an uncorrected mixing of some uni- 
tary dynamics which overall constitutes a dependence on in- 
formation from the M previous steps. Using M different 
quantum coin-walk operators, Ucw{pk) = ^^cw rota- 
tional convenience), generated by {pk}kLi^ the evolution is 
described as the following: 



pMt + M) = TkU^':> pewit + M 



(fc). 



fc)C/^^^ (2) 



Again, ^ F/j ^ 1 and X^fc ^fc = 1- The density matrix 
at each time t > 1 will involve some mixing of the different 
coins-walks, introducing correlations. If M = 1 or Fi ~ 1, 
this reduces to the memoryless QRW. Like Eq. ([T]i, the de- 
gree of correlations can be adjusted by F^. However, unlike 
the previous model, there is no bifurcation or transition from 
bimodality to unimodality in the behavior of the probability 
distribution vs F — see Fig.|3] 

A simple harmonic oscillator model. — A more physi- 
cally relevant picture in which the roles of coiTelations and 
memory-dependence may be explained is through the Hamil- 
tonian formalism. To this end, keeping the discussion simple 



(for numerics), we modify the "Hamiltonian" of the mem- 
oryless coined QRW model so that a history-keeping agent 
can be added. This picture can easily be generalized to more 
realistic cases in which the dynamics is continuous in time 
and also there is no need for an extra quantum coin. The 
Hamiltonian of the memoryless QRW can be found from 
C/cwb) = e'te^^^-f'e-^f by using the Baker- 

Campbell-Hausdorff formula. Now consider that the walker is 
coupled to a simple harmonic oscillator and a reservoir con- 
sisting of a sufficiently large number of excitation modes in 
the following manner: 



CWOR 



cw 



i?o + i?R + i?oR + AP(a + at). (3) 



Although this "Hamiltonian" models a crude simplification, 
clearly lacking various realistic characteristics, to some ex- 
tent it has been inspired by a cavity QED-based proposal for 
a QRW Wh . and serves well enough for demonstration of 
our ideas. In Eq. (O, Hq = ^ua^a, ~ i YlT=i ^feC^Cfc, 
and for the coupling of the oscillator and reservoir degrees of 
freedom we can take, for example, i/oR = g{o-Yl'k'=i '^k + 
X^fc^i '^fc)' where a is the lowering operator of the oscil- 
lator {a^a\n)o = n\n)o, for ^ ?i ^ ?^max < oo) and Ck 
is the annihilation operator of the kth excitation mode. The 
walker-oscillator coupling term, 7?wo = AP(a + a^), im- 
plies that as the walker moves over the lattice, energy is being 
exchanged with the oscillator, and the oscillator gets partial 
information about the walker. This interaction is effectively 
a momentum-position coupling, which preserves the walker's 
momentum. The history-dependence in this model is modu- 
lated by the coupling constant A (A = corresponds to the 
memoryless QRW). The coefficient g, instead, controls the 
effect of the reservoir. The mediated coupling of the oscilla- 
tor to the reservoir may also result in long-term correlations 

— this, however, needs a closer analysis which is beyond the 
scope of this paper. Considering that [Hqw, ^^wo + ^^o] = 0, 
we have J/cwo = Ucwe~^^^'"°'^^°\ To maintain tractability 
of the numerical simulations, here we make the following as- 
sumptions: (i) ignoring the reservoir effect, i.e., g ~ 0, (ii) 
taking a balanced coin-flip {p ~ 1/2) and an initially bal- 
anced coin, (iii) the walker is initially localized at the center, 
(iv) = 5, (v) T = 60, (vi) periodic boundary condition, 
S\L)^fj = \ — L)^, with L = 75, (vii) the oscillator is initially 
prepared at the ground state |0)o, (viii) the oscillator energy 
levels (or Hilbert space) are truncated at rimax = 10, and (ix) 
working in ^ A ^ 1 interval for the coupling constant. 
Validity of assumption (viii) is confirmed through the simula- 
tions noting that after T = 60 the maximum probability for 
|10)o being populated is of the order of lO^^'*. Moreover, we 
have seen that taking L = 75 and T = 60 makes the boundary 
effects insignificant. 

Figure |4] depicts the probability distribution for the modi- 
fied QRW model at T = 60, in which symmetry is accounted 
for by the symmetry of the initial conditions. The distribu- 
tion with A = 0.1 maintains a relatively similar behavior as 
the memoryless QRW — indicating a weak coupling regime 

— whilst there are non-zero probabilities everywhere on the 



FIG. 3: (color online). (Left) Probability distribution P{x, 100) vs F for Eq. jljl and (right) P{x,t) for F = 2/3. In the both plots we have 
taken p = 1/2. 



lattice due to the A-coupling, indicating spreading of the dis- 
tribution as compared to the memoryless QRW. This can can 
be seen in Fig.|5] variance vs time for three different values of 
A, in which a fitting of the form a{\)t^ + h{X)t + c(A) yields 
a(l) « 2.519, a(O.l) « 0.295, and a(0) « 0.292 — a faster 
spreading for the modified model, which may be understood 
by noting that the A-coupling favors hopping of the walker. 

Comparison of the walks. — To make a meaningful com- 
parative analysis of how memory and correlations behave in 
different RWs, we choose a memory-dependent CRW model 
proposed in Ref. ||6|] (for other memory-dependent CRW mod- 
els see, for example, ||2> S H Bl)- This model is interest- 
ing in that it features various aspects of a real-world history- 
keeping systems, such as "saturation" of memory (i.e., finite 
memory capacity). Unfortunately a direct quantum mechani- 
cal extension of the model entails non-linearity and necessity 
of feedback. In this model, memory is based on the "infor- 
mation" of the sites, which is determined by the number of 
the times the walker visits each site as well as the times in 
which these visits occur. The walker hops from site i to a 
neighboring site j with the probability ^ g"(sj-si)^ where 
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FIG. 4: (color online). Probability distribution for the history- 
dependent QRW. A = walk is only plotted at even points and for 
|x-| ^ 60, as it has zero probability at odd points and for |a::j > 60. 
The A = 0.1 walk has non-zero probabilities everywhere on the lat- 
tice. 



Si{t) = ni{m)e~'^^*~™'> is the remaining information at 
site i at time t. Here u is the density of information energy; 
u > (u < 0) corresponds to a walker attracted to (repelled 
by) sites with high information content and u ~ gives the 
memoryless CRW. The coefficient k ^ is the memory decay 
exponent, for our simulations fixed at k = 10^*, and ni{m) 
is 1 if site i was visited at time m and otherwise. A satu- 
rated information amount, Smax, is assumed above which the 
effect of information ceases to increase (s(<) ^ Smax), which 
for our simulations is taken to be 13. The effect of memory 
on the scaling exponents of the RW, in terms of the number of 
sites visited and the distance the walker travels from its initial 
position, has been examined demonstrating that for any 
K > and finite u this RW exhibits a similar scaling behav- 
ior of variance to that of a memoryless CRW. As u ^ oo, 
the scaling behavior of the variance of this model changes 
from ^ T to ~ c, where c is a constant; whilst for 
u — oo, the scaling changes from ^ T to ^ T^. 
For our numerical analysis u remains restricted such that the 
variance behaves as expected for CRW. The probability dis- 
tribution for this memory-dependent CRW is calculated using 
10** independent repetitions and an averaging over the results. 

A standard method to characterize short- and/or long-term 




FIG. 5: (color online). Variance vs time for the modified QRW. The 
inset highlights that 0-^(0.1) > cr^(O.Ol). 
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FIG. 6: (color online). Autocorrelation function C(r), for modi- 
fied QRW (for A = 0, 0.01, 0.1), self-avoiding memory-dependent 
CRW (SAv-CRW), memoryless CRW, and self-attracting memory- 
dependent CRW (SAt-CRW). Closer examination reveals that, from 
top to bottom, the QRW plots are ordered A = 0, A = 0.01, and 
A = 0.1. 



memory-dependent behaviors in data analysis is through cal- 
culation of (auto-) correlation functions 13811 . In the case of 
quantum diffusion systems, it has also been argued that the 
temporal scaling behavior of the correlation function can show 
some universal characteristic relation with the spreading and 
the spectrum Q H S IS S EIll ■ We adopt a modified 
definition for the correlation function as follows. From the 
probabilities at a fixed x* for varying time t (up to T < oo), 

is generated 



the time-series {Px*{t)}f^Q 

C..(t) ^ J:J=o P^'im-it + r) 
definition, to the one used in Refs. 1331 



Next, we define 
e of this 



An advanta: 



34 



, is that 

ours allows to build time-series data for a QRW in the same 
footing as CRW. Besides, it enables application of (classical) 
data analysis tools, e.g., detrended fluctuation analysis 14211 . 
for finding trends and fractal behaviors in a data set. It has 
been shown that the correlation function exhibits a power-law 
(i.e., algebraic) decay as C(t) ~ r where 7 — the cor- 
relation exponent — is related to spectral properties of the 
system 13311 . A small value of 7 is an attribute of a walk 
that stays relatively localized, whilst a large 7 indicates a 
tendency for the walker's distribution to spread with time. 
The correlation function has been calculated for the memory- 
dependent CRW (for u ^ {0, ±0.1}) and the modified QRW 
(for A = {0,0.01,0.1}) at x* ^ 0. The value of C(r) is 
very small for odd values of r. This is because the probability 
of the walker occupying the origin in odd ts is small. These 
probabilities are non-zero in the case of A > as seen ear- 
lier. In CRW and for A = 0, this probability is zero. The 
even (time) points of the coiTelation function have been fit- 
ted to C(r) - a + br-t — Fig.|6]— with 7qrw « 1.153, 
7SAV-CRW ~ 0.01, 7CRW ~ 0.005, and 7sAt-CRW ~ 0.003. The 
behavior of 7 vs A has been plotted in Fig. [T] A preliminary 
analysis suggests that the peak in this plot may be a byprod- 
uct of the finite size of the system. A closer investigation, 
however, may suggest a better explanation for possible un- 
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FIG. 7; (color online). Plot of 7 vs A for the history-dependent QRW. 
7 increases with A, as the peak and subsequent decrease is a conse- 
quence of the finite size of our walker's space. 



derlying reason(s). The property 7^=0.1 < 7«=o < 7m=-o.i 
is in accordance with our understanding about the physical 
meanings of positive and negative us, i.e., self-attracting and 
self-avoiding, respectively. An interesting observation is that 
in the limit of u ^ —00, SAv-CRW and QRW show similar 
general behaviors. 

Summary. — We have introduced simple quantum random 
walk models with memory-dependent features by adding a 
non-Markovian property to the walk as an uncorrelated mix- 
ing of the states at different instants and also by introducing 
a Hamiltonian picture with a memory modulating coupling. 
Variance vs time for the uncorrelated models has been calcu- 
lated. In the Hamiltonian model, we have defined and cal- 
culated the concepts of correlation and correlation exponent 
as useful tools for assessing the effect of memory or corre- 
lation. Comparison with classical memoryless and memory- 
dependent models has indicated an anti-correlation in the 
quantum random walk. Variance as an indicator to distin- 
guish between classical and quantum regimes has apperared 
to be a not so useful tool. We, instead, have suggested that 
tools such as correlation exponents and detrended fluctuation 
analysis are probably more useful in characterizing different 
regimes of a quantum system. These studies may shed some 
light on how different regimes of behaviors in quantum diffu- 
sion systems emerge and how they are related to other phys- 
ical characteristics of those systems. Also, these might have 
some implications on when a quantum random walk based al- 
gorithm for a problem may result in a speedup in comparison 
to classical algorithms. 
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